A BRANCH-AND-BOUND ALGORITHM FOR THE SOLUTION 

OF 

SEQUENCE DEPENDENT ROUTING PROBLEMS 



Michael Joseph DeHaemer 



United States 
Naval Postgraduate School 




THESIS 



A BRANCH -AND-BOUND ALGORITHM FOR THE SOLUTION 

OF 

SEQUENCE DEPENDENT ROUTING PROBLEMS 

by 

Michael Joseph DeHaemer 



April 1070 



Thu docimtnt hau> been appAovtd pabtic Ae.- 
lza(>e. and iaZz; iti> dutA^bution u imtmltzd. 



T13:!757 




'ST 

k. % i. , 



■-.j7tJJfJATE SCnOOU 
*C..Llf- 9394Q 



A Branch-and-Bound Algorithm for the Solution 

of 

Sequence Dependent Routing Problems 



by 



Michael Joseph ^eHaemer 
Lieutenant Commander, United States Navy 
B.S. , University of Notre Dame, 1960 



Submitted in partial fulfillment of the 
requirements for the degree of 



MASTER OF SCIENCE IN OPERATIONS RESEARCH 

from the 



NAVAL POSTGRADUATE SCHOOL 
April 1970 






ABSTRACT 

A branch -and -bound algorithm, which finds the optimal route through 
n nodes when a different cost matrix occurs after each arc in the sequence 
is traversed, is presented. The route may begin at any node and must 
pass through each of the n nodes exactly once. The objective is to mini- 
mize total cost in traversing (n-1) arcs of the route. The cost of traversing 

each arc is r. , , which is a function of the distance between nodes i and j 
11 

th 

and a function of the k position in the sequence of arcs forming the route. 

The algorithm is presented in step-by-step detail and illustrated 
by flow chart and examples . A modification for symmetric (r_) improves 
the efficiency of the algorithm. 

A trade-off between computation time and storage requirements may 
be accomplished by alternate branching policies. Suboptimal solutions 



may be obtained with reduced computation. 
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I. INTRODUCTION 



The algorithm presented in this thesis uses the branch-and-bound 
technique to find the optimal route through n nodes, which passes through 
each node exactly once, while any two of the nodes may be chosen for 
the start and finish of the route. The objective is to minimize total cost 

in traversing the (n-1) arcs of the route. The cost of traversing each arc 

]<^ 

if r.., which is a function of the distance between nodes i and j and a 
ij 

function of the k position in the sequence of arcs forming the route. 

The routing problem that is described and solved is closely re- 
lated to the traveling salesman problem. It differs in that the route is 
not closed and that a different cost matrix occurs after each arc in the 
sequence is traversed. 

Since the branch-and-bound methodology is used successfully by 
Little, et al, [Ref. 1] for solving the traveling salesman problem and 
is recommended by Bellmore and Nemhauser [Ref. 2] for medium -sized 
traveling salesman problems of 13 to 70 nodes, it is expected that the 
routing algorithm which is based on branch-and-bound concepts will 
provide an efficient solution to the sequence dependent routing problem 
and will serve as an alternative to dynamic programming with its large 
computer storage requirements. 

As will be seen, the algorithm successfully solves any of the 
general class of sequence dependent routing problems for which the 
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matrices of all possible costs for traversing arcs can be provided at each 
stage in the sequence of arcs which form a complete route. 



(> 



II. THE BRANCH-AND-BOUND METHOD 



A. GENERAL CHARACTERISTICS 

Virtually all programming techniques, including linear programming, 

dynamic programming, backtrack programming [Ref. 3], and branch-and- 

bound, contrive to find a vector, X* = (x*,x* x*) , which optimizes 

an objective function f(X) • By some search rule elements are selected 

from the product space X xX^x«« ,xX of n "selection spaces" with x an 

i n 

element of X. . Hopefully the searching procedure will be considerably 
more efficient than the trial of all possible vectors in the product space. 

The branch-and-bound search procedure consists of selectively 
partitioning the product space and then computing bounds on the objective 
function for each subset of the partition without enumerating all vectors 
in the subset. For the case in which f(X) is to be minimized, the branch- 
and-bound technique first constructs a lower bound on f(X) for all possible 
vectors in the product space. In the next step of the branch-and-bound 
procedure, the set of all possible solution vectors is partitioned and a 
tightened lower bound on f(X) for each subspace of the product space is 
calculated . 

As an example of these two steps, consider the problem of mini- 
mizing f(Xj^ ,x ^ , . • . /^g) equal to the sum of the elements of X where 
each of the elements of X must be taken from a different row and column 
of a 5x5 matrix. For the first step, compute the sum of the 5 least 
elements in the matrix as the lower bound for ail possible solution 
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vectors. For the second step, select an element of the matrix to be x^. 

The set of solution vectors is now partitioned into the set of vectors 

which have x, = a , for some particular i and j , and the complement of 
1 iJ 

that set. The lower bounds must be calculated for each of the two subsets 
of the partition. 

In general for the branch-and -bound search procedure, further parti- 
tions , "branching" , and tightened bounds are made on the subset which 
has the least lower bound. After sufficient partitions some subset will 

contain but a single vector (x, ,x„ , . . . ,x ) and the bound of this subset 

16 n 

will be the value of the objective function z = f (x, ,x_ , . . . ,x ) . Any 

1 z n 

★ 

of the subsets which have lower bounds greater than z cannot contain 
the optimal solution and may be disregarded in the search for the optimal 

ic 

vector. If z is less than or equal to all the lower bounds on other sub- 

★ ★ ★ -k 

sets, (Xj^ ,X2 ,... ,x^) is an optimal solution . If z is greater than the 
lower bound for some subset of the partitioned selection space, that 
subset must be further partitioned until the process of tightening the 
lower bound proves no optimal solution vectors are present in that sub- 
set, or until an optimal solution vector is isolated. 



B. BRANCH -AN D-BOUND NOTATION 

The following notation is used in the literature with respect to 
the branch-and -bound method [Refs. 1,5, and 6]. 
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X 



a subset of all feasible solution vectors 



Y a subset of X 

Y the complement of Y with respect to X 

WOC) a bound on the objective function for all possible 

solution vectors in X 

The subsets are usually represented as the nodes in a tree of nodes 
and branches with each node labeled by its associated bound. 



W(X) = 1 




Figures similar to this one give the technique its name of branch- 
and-bound . 
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III. THE ALGORITHM 



A. BRANCH -AND-BOUND NOTATION FOR THE ROUTING PROBLEM 

The basic method of the algorithm is to break up the set of all 
possible routes through n nodes into smaller and smaller subsets and to 
calculate for each of the subsets a lower bound on the cost of the best 
route in that subset. The bounds obtained are used as guides for the 
selection of further partitions into smaller subsets. The algorithm 
eventually isolates one or more subsets which are complete routes 
whose costs are less than or equal to the lower bounds for all other 
subsets. Such routes are optimal. 

Arc (i,j) has the usual definition from network theory [Ref. 4] 

i.e. , a directed path from node i node j . The term "leg" refers to 

til 

one of the sequence of arcs which form a complete route. The k leg 
of a route between n cities is that arc (i, j) which is traversed between 
the k^^ and (k+1)^^ cities visited in sequence on the route. The route 
between n cities has (n-1) legs. 

As described in Section II, the algorithm generates a tree whose 
nodes represent subsets of routes. The notation for the nodes of the 
tree is; 

th 

(i,j;k) is a subset of routes which have arc (i,j) for the k 
leg , and 

(r71;k) is the complement of (i,j;k). 
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Matrix reduction is the process of subtracting the minimum element 
in a matrix from each element in the matrix so that the least element in 
the reduced matrix is zero. The amount subtracted from each element is 
called the reducing constant. A set of matrices is called "reduced" if 
the least element in each matrix is zero. 

"Restriction" of the set of cost matrices is the process of deleting 
the matrices and arcs which are no longer possible for the subset of 
routes being considered. 

Arcs and legs are said to have been "committed" after they have 
been chosen to define a subset of possible routes. When (n-1) arcs 
have been committed to (n-1) legs, a route is completely determined. 

Other notation used in the algorithm is listed below. 

the matrix of costs of traversing arc (i,j) on the 
leg of the route. 

a matrix with elements that are the distances between 
pairs of nodes. 



^ / k , 

R. , (r. .) 
k 1) 



A , (a. ,) 
k 1] 



g 



a multiplier (cost per unit distance) that is a function 
th 

of the k sequence position of a route. 

r . summed over the set of (i,j;k) for committed 
^ 1 ] 

arcs and legs . 



M, ,(m..) the current matrix of costs of traversing arc (i,j) on 
k 1] 

the k^^ leg of the route. Initially M^^ = Rj^ but is 
changed by the operation of the algorithm. 



11 



M 



k 



the reduced form of M, . 

k 



q(i ,i, ;k) the reducing constant for M . 

K. K K. 



q(i, / i, /’k) = min.min.m, . . 
k k 1)1] 



X 



represents plus infinity as a matrix element, x is 



used as an element in a cost matrix to block the path 



between the associated node pair. 



W(X) 



the lower bound label attached to the tree for node X. 



6{i, -j, -*k) the second smallest element in M, . 
k k k 




9{i /) ;k ) = max, 9{i, ,j, ;k) . 
o o o k k k 

B. DETAILS OF THE BASIC ALGORITHM 

The algorithm, which is listed here in complete detail, uses the 

branch -and -bound technique to find the least cost route between n 

nodes when the matrix of costs changes for each leg in sequence on 

the route. It is assumed that the set of matrices R, can be specified 

k 

for all (n-1) legs of the route. The range of values for the elements 
of R, is not restricted. 



A simplified flow chart of the algorithm is given in Section III.B.2. 



1 . The Steps of the Basic Algorithm 
Stop 1 



k 



The initial sot up of the algorithm is made as 



fol lows . 
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1 . Set M, = R, for k = 1 , 2 , 

k k 

2 . X is the set of all possible routes. 

3 . Set Z equal to plus infinity. Z will be the 

o o 

cost of the optimal route at the end of the 
algorithm. 



Step 2 



1 . For each k = 1 , 2 ,. . . , n- 1 , find i. , j, , and 

k k 

q(i, / 3, ;k) such that q(i, , j, ;k) = min . min, m, . . 
k k k k 1 3 1] 

• ' k k 

2 . Reduce M, to M, where m,. = m , - q(i, , j, ;k) 

k k 13 1] k k 

for all i, 3 ,k . 

3 . Label node X with \A/’(X) = ^ q(i, ,3, ;k) summed 

k k 

over k = 1,2,..., n-1 . 



Step 3 

Choose the subset for the next tree extension by the 
following procedure . 

'k 

1 . 9 (i, , 3, ;k) = min, , _/ . . m, , for all k of un- 

k k 

committed legs. 6(1^^, jj^;k) is infinity if is 
a single element. 

2. e(i ,3 ;k ) = max 9 (i ,3 ;k). 

000 k k k 

3 . Then Y = (i , j ;k ) and Y = (i ,3 ;k ) are the 
000 000 

next branches from X. 



Step 4 

Label Y by W(Y) = W(X) + 9 (i ,3 ;k ) . 

000 
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Step 5 



1 . 
2 . 

3. 



4. 

5. 

6 . 

Step 6 



Delete M, . 
k 

o 



a . Delete all elements in M, , , except row i . 

k + 1 o 

o 

I 

b. Delete columns i and j in M. 

o o k + 1 

o 



a . Delete all elements in Mj^ _ except 

o 

column i . 
o 



b. Delete rows i and j in M, 

o o k - 1 
o 



Delete rows i and j and columns i and j 
o o o o 



in all M, except for k = k - 1 and k + 1 . 
k o o 



Relabel the matrices as M, . 

k 



Leg k and arc(i ,j ) are now committed, 
o o o 



1 . For each k, where leg k has not yet been 

committed to a route, find i, ,i, and q(i, ,j, ;k) 

k k k k 

such that q(i, , i, ;k) = min. min, m... 

k k 1 ) ij 

I * Ic k 

2. Reduce M, to M, where m,. = m.. - q(i, ,j, ;k) 

k k 1] 1] k k 

for all i,j,k of uncommitted arcs. 

3. Label Y by W(Y) = W(X) + ^ q(i , j ;k) summed 
over k for uncommitted legs. 



Step 7 



If (n-2) legs of the route have been committed go to 
Stop 10 . Otherwise go to Step 8 . 
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Step 8 



1 . Select the node X from which to branch by 
choosing the terminal node which has the 
smallest label W(X) . 

2. than or equal to W(X), the optimal 
route has been found. STOP. 

3 . If X - Y of Step 6 go to Step 3 . Otherwise 
go to Step 9 . 



Step 9 



Set up the cost matrices and label node X as follows, 

r, , summed over the set of 
(i,j;k) for committed arcs and legs. 

2. If no legs have been committed, set M. = R, , 

k k 

otherwise set M, = R, . 

k k 

3. Carry out substeps 1 through 5 of Step 5 for 
each of the committed arcs and legs. 

4. Block paths which are not allowed. 



5, 

6 , 

7, 

Step 10 



Carry out Step 6 substeps 1 and 2 . 

Label X with W(X) = g + q(i, ,j, ;k) summed over 

K. K, 

k for the uncommitted legs . 

Go to Step 3 . 



If W(Y) is less than , set = W(Y) , Go to Step 8 , 
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2 . Flow Chart of the Basic Algorithm 

The flow chart of the basic algorithm is given on the next 



page. 
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( START 



BASIC 

‘ ALGORITHM 



Step 1 



M,=R, for all k. 
k k 

X is the set of aH routes 
is infinity. 



Step 2 



Reduce each M, to M 
k k 

W(X) = sum of reducing 
constants . 

Label X with W(X) . 



Step 3 



Choose Y=(i ,j ;k ) for 
o o o 

next tree extension by 

finding 9(i ,i ;k ) 
o o o 

maXj^e(ij^, jj^;k) . 



Step 4 


t 




Label Y by 


W(Y) 


= W(X)+0(i J ;k ) 
o o o 



Step 5 



!■ 



Form a new set of M by 

K 

deleting matrices and 

elements not compatible 

with committed arc 

and leg (i , j ;k ) , 
o o j 



Step 6 



T 



Reduce M, to M, and 
k k 

label Y with W(Y) = 
W(X) + sum of the 
reducing constants . 



St^g^ 

Select X from which 
to branch as term- 
inal node with 
smallest W(X) . 




reduced matrices 




(N-2) legs been 
committed 
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C. EXPLANATION OF THE ALGORITHM BY EXAMPLE 

A simple numerical example will be used to illustrate the algorithm 
while tracing through the steps detailed in Section III. B.l. 

A Simple Sequence-Dependent Routing Problem 
Suppose an itinerant salesman must be routed so that his travel 
expenses are minimized while visiting 5 different cities. He must 
complete a leg of his route on each of 4 consecutive days . Travel ex- 
penses vary as a function of the day on which the travel occurs. At 
certain times no public transportation is available and the costs reflect 
the price of the available charter transportation. All possible costs 
have been tabulated for each of the 4 traveling days and are presented 
in Figure 1 . 

Step 1 

The set of M^^ are the set of matrices of Figure 1 . 

Step 2 

The set of reducing constants is q(l , 2; 1) = 3 , q(2 , 3;2) = 5 , 

q(5 , 4;3) 2 , and q(4 , 5;4) = 1 . The set of M, is reduced to the set of 

k 

I 

Mj^ shown in Figure 2. W(X)=3 + 5 + 2 + l = ll, which is the sum of 
the four reducing constants . 

Since the route must have four legs, it must as a minimum 
have a cost equal to the sum of the least elements in each of the four 
cost matrices. Therefore W(X) is indeed a valid lower bound. 
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The initial set of cost matrices- 
Figure 1 
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Reduced matrices at the end of Step 2 . 
Figure 2 



Ml M3 



1 
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3 



1 2 

X 0 
7 X 
20 9 



_3 

8 

4 

X 



J.__2 3 

X 1 6 

8X0 
21 19 X 



_4 
’ 7 
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1 1 



Restricted set of matrices at the end of Step 5. 



Figure 3 
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Step 3 



0(i , j ;k) = l,l,l,5fork = l,2,3,4 respectively. Hence 

0(i /j ;k ) = 0(4, 5;4) = 5 and the two subsets (4, 5, '4) and (4 , 5; 4) are 
o o o 

chosen for the next extension of the tree. 

Step 3 partitions X into subsets Y and Y by choosing the arc 

and leg on which to base the next branching. The object is to include 

in the route the arc and leg which is judged most likely to be on the 

optimal route. It is argued that one of the zero elements is a likely 

candidate to be on the optimal route; and that arc and leg are chosen 
'k 

which have m,. equal zero and which, if not chosen, cause the greatest 
1 ] 

possible alternative cost. The arc and leg so chosen will raise the 

I 

bound on Y the most. For each reduced matrix M, a 0(i, ,j, ;k) equal 

k k k 

to the second smallest element in the matrix is calculated. 0(i, ,j, ;k) = 

k k 

I 

0 if M. has two or more zero elements. The maximum over k of the 
k 

0{i ,j ;k) is the highest cost for not placing the zero cost arc on leg 

k of the route . 
o 

Step 4 

W(Y) = W(X) + 0(4, 5;4) = 16. 



Step 5 



The new restricted sot of is formed by eliminating arcs 

I 

in the M matrices which are not possible for subsets of routes in Y. 

Since the subset (4,5;4) was chosen, the restricted set of M. shown 

k 

in Figure 3 are formed as follows. 
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1 . M . is deleted . 

4 

' ' 3 

2. All of M 2 except column 4 is deleted, and and 

■ 3 

m,. . are also deleted. 

54 

I I 

3. Rows and columns 4 and 5 are deleted from M^and • 
The restrictions brought about by the choice of arc (4,5) for 

leg 4 are now satisfied. Leg 3 must end at city 4 and no other legs are 
allowed to start or end at cities 4 and 5. It should be clear that if leg 
4 were not the last leg in the route, in accordance with the algorithm, 

I 

leg 5 would be restricted to begin at city 5 and the restricted form of M 

o 

would have elements only in row 5. 

Step 6 

The set of q(i , j, ;k) =0,0,1 for k = 1,2,3 respectively . 

K. K 

Hence W(Y) = W(X) + 1 = 12. The restrictions introduced in Step 5 make 

I 

it impossible to use the zero cost arc in the M matrix at the end of 

o 

Step 2 . The lower bound is therefore tightened by the amount of the 

least element in the current M . Figure 4 shows the set of reduced 

o 

matrices and Figure 5 shows the labeled tree that has been constructed 
up to this point. 

Step 7 

Only one leg has been committed, so Step 8 is next. 

Step 8 

Node (4,5;4) has the smallest lower bound and is chosen 

for the next X from which to branch. Z remains infinity. Since X is 

o 
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the same as the last Y, Step 3 is executed next. Step 9 is bypassed in 
this case since the correct set of M is available from the end of Step 6. 
Second Iteration 

Based on the set of matrices in Figure 4, 0(i ,j ;k ) = 

o o o 

9(3, 4;3) in Step 3 and the tree is extended to (3,4;3) and (3 , 4 ; 3 ) . In 

I 

Step 4 W(Y) = 12 + 5 = 17. After Step 6 the set of M is that of Figure 6. 

K. 

Since all the reducing constants are zero, (3,4;3) is labeled with W(X) + 

0 = 12 . In Step 8 (3 ,4;3) is selected to be X and the third iteration begins 
with the execution of Step 3 . 

Third Iteration 

In Step 3 Y is chosen to be (1,2;1) since 9(i ,i ;k ) = 

o o o 

9(1, 2;1) = 7. Therefore (1,2;1) is labeled with 19. After Step 5 only 
the single element for arc (2,3) in leg 2 remains. A complete route is 
now isolated since leg 2 with only one possible element must be included. 
After Step 6 the cost of leg 2 is incorporated in the label of (1,2;1) which 
is now also the total cost of the route. Steps 7 and _1^ are executed so 
that = 12 , the label on (1,2;1), Finally, since no terminal node has 
a label less than 12, the algorithm is stopped in Step 8 . 

The optimal route is (1,2), (2,3), (3,4), (4 , 5) at a cost 
of 12. The completed tree for the problem is shown in Figure 7. Whereas 
complete enumeration would have required the calculation of the costs 
of 120 different possible combinations, branch-and -bound finds the 
optimal solution by calculating the complete cost of but a single route 
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and the lower bound on three other sets of routes. This clearly demon- 



strates the powerful potential for efficiency of the branch -and -bound 
technique . 

If the calculation of a label for a node in branch -and -bound is 
considered comparable to the evaluation of the recursive equation for 
one value of a state variable in dynamic programming, an approximate 
comparison of efficiencies between branch -and -bound and dynamic 
programming may be made. The dynamic programming solution to the 
problem just solved would have required evaluation of the recursive 
equation for 30 different values of the state variable and 30 comparisons 
to select the optimal route. The bra nch-and -bound solution requires 
the calculation of 7 node labels and 15 comparisons for both the select- 
ion of the X nodes from which to branch and the selection of the Y nodes 
for tree extension. Consequently, for this particular problem, the 
branch-and -bound algorithm is the more efficient solution procedure. 

D. A CONSTANT DISTANCE AND VARIABLE COST RATE (C, ) PROBLEM 

k 

A problem of some interest is the minimum cost route when the 
cost for each leg is the product of distance traveled and a sequence 
dependent cost factor. The branch-and -bound algorithm is used to 
solve this type of problem in the example below. 

A Constant Distance, Variable Cost Rate Example 

The optimal route passing through 6 cities is desired. The cost 

of travel between a given pair of cities is c, a.,, c, is a function of the 

k ij k 
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Initial set of cost matrices. 



day on which travel is performed and is called the daily cost rate. It is 
assumed that each leg of the route will be traversed on a different single 
day. Five days are required for travel. The cost rate (units of cost per 
unit distance) for each day is given in Figure 8 and the distance matrix 
in Figure 9 . 

The set of (n-1) cost matrices, where R, = c, (a..), is formed and 

k k 1] 

I 

shown in Figure 10. The set of reduced matrices after Step 2 of 
the algorithm is shown in Figure 11. After the first iteration of the 
algorithm is completed through Step 6 , the labeled tree is that shown 
in Figure 12 . Since the bound on the left hand node is less than the 
bound on the right hand node, Step 9 of the algorithm is executed. 

Arc (2,5) is blocked for leg 5 by setting m^^ to plus infinity. The set 
of matrices is reduced and shown in Figure 13. The sum of the reducing 
constants is found to be 20. Since g is zero (no arcs have been com- 
mitted in this subset), the label for the node is 20, which agrees with 
that determined on the first iteration for Y. 

The completed tree for this example is shown in Figure 14. Only 
one complete route is enumerated by the algorithm, the optimal route 
(2,5), (5,1), (1,6), (6,3), (3,4). It is noteworthy that four consecu- 
tive nodes in the left most branch of the tree have the same lower bound. 
Examination of the reduced matrices for (2 ,5;2) reveals the reason. 

0(i, ,j, ;k) in each matrix of Figure 15 is zero. All of the 0(i, ,j, ;k) 
k k k k 

remain zero in later branches until sufficient arcs have become blocked 
to make at least one 0(i ,j ;k) different from zero. 

K K 



26 



- LO 



- ^ 



CO 



CD 


o 


LO 


LO 


LO 


LO 


X 




r— 1 


CO 


I-H 


r-H 




lO 


o 


o 


LO 


LO 


X 


o 




CO 




r-H 


CM 


I-H 




LO 


o 


LO 


X 


LO 


o 




CO 








CM 


CO 


LO 


o 


X 


o 


o 


LO 




CM 


CM 


CM 


I-H 


r-H 


CM 


LO 


X 


LO 


O 


LO 


LO 






CO 


CM 


CO 


CM 


1— H 


X 


o 


LO 


O 


LO 


LO 






CM 


r-H 




I-H 


CD 






CD 


CD 


CM 


X 






r-H 








LO 


CM 


o 


CD 


O 


X 






r— 1 






I-H 






rr 


CD 


CM 


X 


CM 


00 




i-H 


I-H 








CO 


o 


00 


X 


00 




CD 




r— 1 










CM 


CO 


X 




00 




o 




I-H 


I-H 




r—H 


I-H 


r— 1 


X 


CD 


o 




CM 


CD 




I-H 


r-H 








CD 


CD 


I-H 


C7^ 


O) 


CO 


X 






CM 










LO 


00 


o 


CD 


LO 


X 


CD 




i-H 






r-H 






1— H 




CO 


X 


CO 


CM 




CM 


CM 






I-H 


CO 


LO 


CM 


X 


CM 


CD 


CD 




I-H 


I-H 


I-H 






CM 




X 


r-H 


CM 


I-H 


LO 




CM 


CM 


I-H 


CM 


I-H 


1— 1 


X 




LO 


CD 


CO 


CD 




CM 


r-H 








CD 


CM 




CO 


CO 


I-H 


X 


LO 


CD 


o 


CO 


LO 


X 


CM 






00 


I-H 


X 


I-H 




CO 


LO 




X 




CM 


CO 


CM 


CD 


X 






IS. 


LO 


r— 1 


X 


00 


LO 


CM 


I-H 


CO 


CD 


00 


00 


CM 


CM 




X 






CM 


I-H 


I-H 




LO 




O 


CM 


o 


X 


00 




CM 




r-H 


CM 






00 


CM 




X 




CO 




CM 


CO 






I-H 


CO 


O 


CD 


X 


CD 


00 


CM 




CM 


r-H 


I-H 




I-H 


CM 


CD 


X 


00 


CD 


00 


o 




CO 


CM 


r-H 


CM 


CM 


r— 1 


X 


CM 


O 


00 




CM 




CO 


CM 






I-H 




1— H 


CM 


CO 




LO 


CO 



a 

0 

4-J 

CO 

u 

0 



(0 

CO 

0 

O 



0 

6 

0 

O 

o 

T5 

0 

a: 



0 

u 

CTJ 




27 



Labeled tree at end of first iteration. 
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(all routes) 
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Figure 14 
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The question arises of what branching rule to use when the values 
of equal for two or more k. Of course, the best branching 

choice is that which causes as few other iterations as possible. But no 
rule that can be proved is known for making the choice. As shown in 

I 

the tree, branching choices were made by taking zeroes in M in the 

JC 

order in which they appeared in the matrix. Leg 5 was chosen because 
c was the highest cost rate multiplier and the route cost could be 

D 

t 

lessened by at least 5 units if one of the zero valued arcs in M could 

o 

be placed on the route. 

In any case no branching rule can eliminate the further branching 
required from (m-1) left hand nodes when m zeroes occur in a reduced 
matrix that is not symmetric. In Section III. E. the algorithm for the 
symmetric cost matrix case is discussed. 

The branch -and -bound algorithm required the calculation of 33 
labels and required the performance of 54 comparisons in order to choose 
Y nodes and 120 comparisons to find the X nodes from which to branch. 

For complete enumeration the cost of 720 different routes would be 
computed and compared. Dynamic programming would require 62 evalua- 
tions of the recursive equation and 62 comparisons to find the optimal 
route. The structure of the problem solved here causes numerous branches 
and increases the number of nodes that must be considered in the search 
for the next X node from which to branch further. Consequently for 
problems which generate numerous branches, branch-and -bound solu- 
tions may be inferior in efficiency to dyriamic programming. 
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E. 



SYMMETRIC COST MATRICES 



^ • Efficiency of Basic Algorithm for Symmetric Cost Matrices 

The basic algorithm presented in Section III. B. will succes- 
sfully solve the routing problem when all cost matrices are symmetric, 
but with poor efficiency. Symmetric cost matrices cause an increase in 
the number of branches because every reduced matrix will have two zero 
elements for the first iteration of the algorithm. The example in Section 
III. D. showed that multiple zeroes in the reduced cost matrices cause 
the branch -and -bound algorithm to be less efficient. A short example 
with symmetric cost matrices is given here to illustrate the difficulty 
inherent in symmetry for the basic algorithm. 

Figure 16 is the set of four symmetric cost matrices for 
which a minimal cost route is to be found. Figure 17 is the solution 
tree which results from the use of the basic algorithm presented in 
Section III. B. Twice in the leftmost branch of Figure 17, two branchings 
occur before the lower bound is raised. This double branching caused by 
symmetry is avoided if a modification of the basic algorithm is used. 

2 • Modification to the Algorithm for Symmetric Matrices 

In the modification of the algorithm, the arcs are considered 
undirected and the direction of the route is not specified until two adja- 
cent legs are committed. The nodes of the tree are redefined as (i,j or j,i;k) 
with complementary node (171 and J7i;k) . The definition of a "directed" 
leg is necessary for the modified algorithm. 
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Leg k is said to be "directed (i,j)" if leg k is committed and 

the only possible direction for the route in leg k is from i to j . 

Step 5A of the modified algorithm is used to specify direction 

for the set of directed legs. If leg k^ is already directed, Step 5 of the 

basic algorithm is executed following Step 5B . Step 5 is more restrictive 

than Step 5C of the modification, in the sense that more matrix elements 

are deleted. Step 7 is changed in order that the direction of the last leg 

committed to the route can be determined . Step 9 is modified to account 

for the difference between "directed" and "undirected" legs. 

Because of symmetry only upper triangles of the cost matrices 

are used in the modified algorithm. This results in a reduction of storage 

2 

required by the amount n(n - l)/2. 

The basic algorithm is modified for the symmetric cost matrices 
by inserting Step 5A , Step 5B , and Step 5C between Step 4 and Step 5 in 
the basic algorithm and by making changes to Step 7 and Step 9 . The 
details of the modification are given immediately below. 

Step 5A 

1. If neither leg (k + 1) nor leg (k - 1) has been com- 

o o 

mitted go to Step 5C . otherwise, go to substep 2. 

2 . Set t = k ,u=i ,s = j.. Execute the first of substeps 
o o o 

3, 4, 5, and 6, which is applicable. 

3. a. If leg (t + 1) has undirected arc (p,q) then 
(1) if s = p, leg t is directed (u,s) and 
leg (t + 1) is directed (p,q). 
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(2) if s = q , leg t is directed (u,s) and 
leg (t + 1) is directed (q,p). 

(3) if u = p, leg t is directed (s,u) and 
leg (t + 1) is directed (p,q). 

(4) if u = q, leg t is directed (s,u) and 
leg (t + 1) is directed (q,p) . 

b. Then if leg (t - 1) is committed and undirected, 

set t = t - 1 and execute substep 4 below. 

Otherwise go to Step 5B . 

4. a. If leg (t + 1) is directed (p,q) and leg t has 

undirected arc (u , s) then 

(1) if s =p, leg t is directed (u,s). 

(2) if u = p, leg t is directed (s,u). 

b. If leg (t - 1) is committed and undirected, set 

t = t - 1 and repeat substep 4 . Otherwise go 

to Step 5B . 

5. a. If leg (t - 1) has undirected arc (p,q) then 

(1) if s = p, leg t is directed (s,u) and 
leg (t - 1) is directed (q,p). 

(2) if s = q, leg t is directed (s,u) and 
leg (t - 1) is directed (p,q). 

(3) if u = p, leg t is directed (u,s) and 
leg (t - 1) is directed (q,p). 
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(4) if u = q, leg t is directed (u,s) and 



ordered pai 
algorithm . 



leg (t - 1) is directed (p,q). 
b. If leg (t + 1) is committed and undirected, set 

t = t + 1 and execute substep 6 below. Otherwise 
go to Step 5B . 

6. a. If leg (t - 1) is directed (p,q) and leg t has 
undirected arc (u , s) then 

(1) if s = q, leg t is directed (s,u). 

(2) if u = q, leg t is directed (u,s). 

b. If leg (t + 1) is committed and undirected, set 
t = t + 1 and repeat substep 6 . Otherwise go to 
Step 5B . 

Step 5B 

If leg is directed (p,q) as a result of Step 5A , the 

for Step 5 is (i , j ) = (p, q) . Go to Step 5 in the basic 
— o o 

Step 50 

I 

1 . Delete M, . 

k 

o 

I 

2 . Delete all elements in M, except rows i 

k +1 o 

o 

and j • 
o 

I 

3. Delete all elements in except columns 

o 

i and j . 
o o 
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4. 



, whichever is present 



Delete m. , or m, . 

1 ] ] 1 
o o o o 

in the upper triangle of the matrix, for k = k - 1 

o 

and k = k -i- 1 . 
o 



5. 


Delete rows i and j and columns i and j 
o o o o 

1 1 

in all matrices except M, . _ and M, ^ . 

k +1 k “1 

o o 


6. 


Relabel the matrices as M, . 

k 


7. 


Leg k and arc (i ,j ) are now committed, 
o o o 


8. 


Go to Step 6 . 


Changes to Step 7 and Step 9 


1 . 


In Step 7 change " (n - 2)" to " (n - 1)" . 


2. 


Replace substep 3 in Step 9 with 

"3. Carry out Step 5, substeps 1 through 5, 
for each of the directed legs and Step 5C , 
substeps 1 through 6, for each of the com 
mitted but undirected legs." 


An Example 


Using the Algorithm Modified for Symmetric 



Cost Matrices 



Once again suppose a minimum cost route for the set of 
matrices in Figure 16 is to be found. 

First Iteration 

I 

The set of reduced triangular at the end of Step 2 is 
shown in Figure 18. The reducing constants q(l,2;l), q(2,3;2), q(l,2;3) 
and q(4,5;4) are equal to 3,5,3, and 1 respectively so that the label 
of the first node of the tree is 12. 
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In Step 3 6(i ,i ;k) is found to be 9(4, 5;4) which eauals 3. 
o o 

In the modified algorithm the Y node for the next branch is chosen to be 
(4,5 or 5,4;4) and Y is the complement (4,5 and 5,4;4) which is labeled 
by W(X) + 9(4 , 5;4) = 15 in Step 4 . 

Since no legs have been committed yet in this first iteration, 
Step 5C is executed immediately following the first substep of Step 5A . 

I I 

is deleted . All the elements in except columns 4 and 5 are 

I I 

deleted. Columns and rows 4 and 5 are deleted in and • The set 

I 

of matrices formed by restricting the set of M. are relabeled as the set 

k 

of M which are to be operated upon in Step 6 and which are shown in 
Figure 19. 

In Step 6 q(3,4;3) = 4 is the only non-zero reducing constant 
so that Y is labeled by 16. Since only one leg of the route has been 
committed , Step 8 follows Step 7 . 

In Step 8 (4,5 and 5,4;4) is selected as the next node from 
which to branch. 

In Step 9 g = 0 since no legs have been committed in the 
subset being partitioned by node X. M is set equal to R for all k. 
Substep 3 requires no action since there are no committed arcs and legs. 

4 

r,^ is set equal to infinity in order to block arc (4 , 5) . The set of M, is 
45 k 

reduced by substep 5 and X is labeled by the sum of the reducing con- 
stants which equals 15. Step 3 which is executed next begins the second 
iteration . 
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Reduced cost matrices at the end of Step 2 . 
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Second Iteration 



At the end of Step 6 , Y = (3,4 or 4 , 3 ;4) has a label of 2 1 and 

Y as a result of Step 4 has a label of 20 . In Step 8 (4 , 5 or 5 ,4;4) has the 

smallest label and is selected as the branch point for the next iteration. 

4 

In Step 9 9 “ ^45 “ ^ since there is only the one committed 

I 

leg. M is set equal to R for all k. Step 5C is carried out for the single 

K. K. 

committed but undirected leg 4 with arc (4,5). No paths need be blocked in 
in substep 4 . After Step 9 is completed the set of cost matrices formed 
for the next iteration is given in Figure 20. This is the same set of 
matrices which would have been formed by reducing the set of matrices 
after Step 5C in the first iteration which are shown in Figure 19. 

Third Iteration 

9(i, , j ;k ) = 6(1 , 2;1) =4 in Step 3 , so Y is (1 , 2 or 2 , 1; 1) . 
loo 

As a result of Step 4 Y is labeled by 20. 

Since leg 2 has not yet been committed, the direction of the 

I 

route is still not determined, and Step 5C follows Step 5A. is 

I 

deleted. Row 3 is deleted from M 2 . After being redesignated as 
the new M 2 and M^ are shown in Figure 21. 

In Step 6 all reducing constants are zero causing Y to be 
labeled by 16. In Step 8 Y becomes the chosen branch point for the 
next iteration. Stop 9 is not required in the present iteration. 

Fourth Iteration 

9(i , i ;k ) - 9(3 , 4;3) in Stop 3 . Y is then (3,4 or 4 , 3;3) . 
000 — 

Y is labeled by 26 in Step 4 . Only the direction (3,4) is compatible 
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Figure 21 
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with the arcs specified for leg 4. Leg (k + 1) is leg 4, which is com- 

o 

mitted and undirected, so that substep 3. a is applicable. Therefore, 

leg 3 becomes directed (3,4) and leg 4 becomes directed (4,5). Step 5 

follows Step 5B . At the end of Step 6 only two elements in the single 

2 2 

matrix M 2 remain, m ^2 “ ^ and ’^ 2 '^ ~ Consequently the reducing 
constant is zero and Y is labeled by 16. The next X for branching in 
Step 8 is again the Y at the end of Step 6 . 

Final Iteration 

The single zero element leads to (i ,j ;k ) equal to (2,3;2) 

000 

in Step 3 . ^ is labeled with 16 + 6 = 22 in Step 4 . For Step 5A leg 

(k + 1) is leg 3 which is already directed so that substep 4. a is 
o 

applicable and leg 2 becomes directed (2,3). Since leg 1 is undirected 
substep 4 is repeated, and leg 1 becomes directed (1,2). In Step 5 the 
last matrix is deleted. Since all legs have been committed, in Step 6 
Y retains the same label as X which is 16. (n - 1) legs of the route 



o 



have now been assigned so that Step 10 follows Step 7 . In Step 10 Z 
is set equal to 16. In Step 8 is found to be less than or equal to 
the smallest label on any terminal node. Therefore, the optimal route 
has been isolated and the algorithm is terminated. 

The final solution tree is given in Figure 22. Only one 
connected path is contained in the nodes listed in the tree. The set of 
directed legs form the optimal route (1 , 2) , (2,3), (3,4), (4,5). A com- 
parison of Figures 16 and 22 shows that three branchings in the leftmost 
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portion of the tree are eliminated by the use of the modified algorithm. 
For large problems the modified algorithm is expected to produce sig- 
nificant savings in storage and computer run time. 



F . ADDITIONAL APPLICATIONS 

Numerous applications may be constructed which specify arrival 
times, departure times, lay-overs, and other aspects of a routing 
problem. The following examples show that certain kinds of constraints 
can be quite easily entered into the algorithm. 

1 . A Constraint Specifying an Arrival Date for a Given City 

Suppose travel times vary because of transportation schedules 

and the objective is to minimize travel time with the additional con- 

th 

straint that the route must arrive at city m on the k day of travel over 
the route. The constraint is easily entered by restricting R to column 

K. 

k and R to row m , since arrival at city m must occur on leg k and 

K."T* J. 

departure from city m must occur on leg (k + 1) . 

2 . A Constraint Specifying an Arc of the Route 

Suppose the objective is a minimum cost route with the 
constraint that one leg will connect city p to city q. The constraint 
is entered by blocking all arcs from city p to cities other than q and 
blocking all arcs to q from other cities than p in all of the set of 

3 . A Minimum Weight-Distance Shipping Route Problem 

A domestic firm has ordered 8 units of heavy industrial equip- 
ment from a foreign manufacturer and desires to minimize the costs of 
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transporting these units to the plant sites that require them. The manu- 



facturer will deliver all the units to a single point of entry. The firm may 
choose any one of the plant sites as the point of entry without any addi- 
tional charges by the manufacturer. The firm must then use a special van 
to transport and install each of the units of equipment in each of the 
several plant sites. 

The cost of transportation of the units is proportional to the 
weight-distance hauled. In addition, a minimum cost per unit per day on 
board is incurred when the special van is not moved a minimum distance 
in a day. Each unit of equipment weighs the same. The number of units 
for each plant site is given below. 

Number of units Plant Number 



1 

2 

1 

2 

1 

1 



1 

2 

3 

4 

5 

6 



The distance between sites is symmetric, so the transpor- 
tation costs per unit for haulage between sites is symmetric and is 
given in the triangular matrix in Figure 23. 

A unit can be installed on the same day that it arrives at a 
plant site. But no more than one unit can be installed on a single day, 
so that charges for a day of storage result for each additional unit 



installed at the same site. 
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Cost per unit hauled between plant sites 
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(a..) Matrix 
ij 

Figure 24 
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The first unit is installed at the time of arrival of the entire 



shipment at the first plant site. Thereafter the costs are based on the 

number of units hauled or stored until the special van is empty. 

Site 2 and site 4 are made into two sites each so that the 

storage cost of 10 per unit per day may be entered into the cost matrix 

as shown in Figure 24. The problem is now in the form amenable to 

solution by the routing algorithm. A unit of equipment is installed on 

each leg of the route, and the cost for the leg is the product of one 

element from the cost-per-unit matrix times the number of units left at 

the beginning of that leg. In the notation of Section III. A. (Cj,C2«. .. / 

c ) = (7,6,.,.,!), each c is the number of units yet to be installed 

at the beginning of the leg. (a_) is the cost matrix of Figure 24. 

R = c (a, ,) for k = 1,2,.. .,7. Since each of the R, is symmetric , the 
K K 13 K 

algorithm as modified in Section III. E. may be used to find the sequence 
of deliveries of the equipment which minimizes the cost to the firm. 

4 . Problems Including Both Cost and Profit 

Although only non-negative elements have been used in the 
cost matrices of the examples, negative costs are permitted; and, in 
fact, with the use of negative elements, negative labels may occur in 
the tree constructed by the algorithm. Consequently, net costs after 
subtracting profits for a given day's travel may be entered in the cost 
matrices. The algorithm is then used to produce the optimal net cost 
route which will have value loss than zero if there is an overall net 
profit . 
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G. SPECIAL CASES SOLVED BETTER BY OTHER METHODS 

1 . Identical Cost Matrices for Each Leg 

Suppose the optimum route is desired where R, = R, for all 

1 ] 

i,j. This problem may be more efficiently solved by converting it to a 

traveling salesman problem by injecting one more city, say city (n + 1), 

and specifying that r ,, ,=r, . = 0fori,j = l,2,.. .,n. The recom- 

n+i , j 1 , n+i 

mendations of Ref. 1 may then be followed in finding an efficient way to 
solve the problem. The optimal traveling salesman route will contain 
the optimal route through the original n cities. The beginning and end 
of the optimal route desired are the cities which connect with the arti- 
ficial city that was injected to obtain a solution. 

2 . Cost Rate Constants Form a Monotonic Sequence 

If the optimal route is to be found from a set of (r_) matrices 

]<^ 

where r,, = c, a., and if the set of c, and the matrix (a..) have special 
1] k 1] k 1] 

properties, the optimal route may be found very simply without recourse 
to this algorithm. 

If the set of c form a monotonically decreasing sequence for 

K. 

k = 1 ,2 , . . . ,(n - 1) , and if the shortest route using the distances in 
(a )is found to be a monotonically increasing sequence of arc lengths, 

ij 

the least cost route is the same as the shortest route of (a_) . Further- 
more, the cost of the optimal route is the sum of the pairwise products 
of the elements taken in order from each of the two sequences. The same 
result is true if the directions of monotonicity were reversed for both 



sequences , 
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A theorem with respect to the minimum sum of pairwise 
products of the elements of an ascending and a descending sequence is 
presented in Ref. 5. 



48 



IV. DISCUSSION 



The sequence dependent route through n cities is closely akin to 
the traveling salesman problem. In fact if an additional leg were added 
to close the circuit back to the start of the route, the problem would be 
that of the traveling salesman with route costs changing after each arc 
is traversed. Consequently, the literature on the traveling salesman 
problem - in particular Little, et al [Ref. 1] , the survey of the traveling 
salesman problem by Bellmore and Nemhauser [Ref. 2] , and the survey 
of the branch-and -bound method by Lawler and 'vVood [Ref. 6] - contain 
much relevant comment. 

A. BRANCH -AND-BOUND COMPARED WITH DYNAMIC PROGRAMMING 
The number of computations, the storage space, and solution time 
required for the solution of the optimal route problem are exactly deter- 
mined by the number of elements in the cost matrices when dynamic 
programming is the solution method. These three factors are quite 
variable for the branch -and -bound method. All three depend on the 
number of nodes which must be generated in the tree to solve the problem. 
In many cases, such as the example in Section III. B, branch-and -bound 
is superior to dynamic programming in all three factors . Comparison 
for the traveling salesman problem in Ref, 2 shows that branch-and- 
bound provides lower average solution times with a much larger variance 
than similar problems solved by dynamic programming. For practical 
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purposes dynamic programming is restricted to the solution of routing 
problems with fewer than 15 nodes on the route. The storage requirements 
for the values of the recursive functions in dynamic programming for a 
15 node problem is 24,024 [Ref. 2]. For larger problems branch -and -bound 
methods prove superior by reducing the storage requirement. 

B. STRATEGIES OF BRANCHING 

The strategy used for the selection of the next branch point has a 
direct effect on the storage requirements for the branch-and-bound 
algorithm to solve the routing problem. The policy used in the flow chart 
is to branch from the lowest bound. This policy has the advantage of 
minimizing total computation, in the sense that any branching performed 
is also that which must be performed under any alternate policy. How- 
ever, under a "branch from the lowest bound" policy, no terminal nodes 
are discarded and the volume of storage may become excessive. The 
alternate strategy is to branch always from the newest active node and 
to discard nodes from storage that are out of the competition for the 

optimal route. Very few nodes are then kept in storage on the 

order of a few n [Ref. 1] . For this second strategy in the routing 
algorithm, branching would always be to the right until a complete route 
was enumerated or the bound exceeded the cost of a complete route 
already found. Then the process would work backwards up the branch 
until a left hand node with lower bound less than the cost of the completed 
route was found. The nodes that were passed by could be discarded from 
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storage and branching would be continuously to the right again from the 
selected node. This procedure saves storage but increases the number 
of computations and the solution time because many nodes are calculated 
unnecessarily when compared with the first strategy. 

C . SUBOPTIMIZATION 

A very useful feature of the branch-and -bound routing algorithm 
is that it allows accepting the solution and terminating the computation 
when a satisfactory suboptimization solution has been found. For in- 
stance, if the objective is to find a route that meets a budget constraint, 
the branch to the right strategy may be used, and the computation ends 
as soon as a single route with cost less than the budget constraint has 
been found; or using the branch from the lowest bound policy, computa- 
tion ends when it is determined that no route less than the budget con- 
straint exists. In addition Ref. 6 gives branch-and -bound search 
procedures that are applicable to the routing algorithm for finding sub- 
optimal solutions that are within a given percentage of the optimal and 
also for finding the best suboptimal solution under a solution time 
constraint . 
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V. CONCLUSIONS 



The branch-and-bound algorithm can successfully find the optimal 
route for a variety of sequence dependent routing problems, including 
those with symmetric cost matrices, when the matrices of all possible 
costs for each leg of the route is known. On the basis of experience 
with the traveling salesman problem, the branch-and-bound routing 
algorithm is expected to be competitive with dynamic programming for 
routes involving fewer than 15 nodes and superior for larger problems. 
Under the branch-and-bound algorithm, storage requirements may be 
traded for increases in solution time and the number of computations . 
This trade-off is accomplished by the selection of the branching strategy 
used in the algorithm. Experience from digital computer runs is neces- 
sary to provide more quantitative recommendations for branching pro- 
cedures. Finally, only the branch-and-bound algorithm provides a 
rapid suboptimal solution when these are acceptable. 
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